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Abstract 

Nice formulae for plane partitions with bounded size of parts (or boxed 
plane partitions), which generalize the norm-trace generating function by 
Stanley and the trace generating function by Gansner, are exhibited. The 
derivation of the nice formulae is based on lattice path combinatorics of 
biorthogonal polynomials, especially of the little tj-Laguerre polynomials 
and a generalization of the little (j-Laguerre polynomials. A summation 
formula which generalizes the (j-Chu-Vandermonde identity is also shown 
and utilized to prove the orthogonality of the generalized little (/-Laguerre 
polynomials. 


1 Introduction 


A plane partition n of a nonnegative integer N is a two-dimensional array 


( 7Tl,l 7 Ti,2 7Ti, 3 ■ ■ h 

7 ^ 2,1 Til,2 7*2,3 ' ' ' 

7 ^ 3,1 ^ 3,2 n 3,3 ' ' ' 


V : J 


( 1 ) 


of nonnegative integers 7r,y such that YTj=l n i,j ~ ^ an d n i,j — max { TZ i+l,j' n i,j+ 1) 
for every ( i,j) € . (Throughout the paper we write for the set of in¬ 

tegers at least k.) A plane partition n distributes N among its parts n, : j so that 
each row and each column are non-increasing. MacMahon studies plane par¬ 
titions in depth and finds the norm generating function for plane partitions (of 
rectangular shape) with bounded size of parts 


E ? 

n£V(r,c,n) 


r— 1 c— 1 n —1 

nnn 


i =0 ;'=0 k =0 


1 - qi+j+ k + 2 

1 — qi+j+k+l 


( 2 ) 


where V{r, c, n) denotes the set of plane partitions of at most r rows and at most 
c columns with parts at most n, namely n 6 V(r,c,n ) if and only if 7T r+! y = 


1 



n IfC+ j — 0 for every (i,j) € Z>! and ziyi < n, and | n\ — Hq=-\ ^i,j that is called 
the norm of n. The limit n —> oo reduces © to the norm generating function for 
plane partitions with unbounded size of ports 

e ? w =nn(i-? , ' +/+ 1 r 1 ( 3 ) 

nEV(r,c) i =0 j—0 

where V(r,c) denotes the set of plane partitions of at most r rows and at most 
c columns. (No restriction is imposed to the size of parts.) See MacMahon's 
book ll8[ Section IX] for details. 

Generalizing the norm generating functions (|2]) and |3| is an important sub¬ 
ject in the study of plane partitions. In particular a great progress is made by 
Stanley who considers the trace of plane partitions, 

00 

tr (» = E n hi' ( 4 ) 

i=1 

and finds the norm-trace generating function 

E qWa tT W = nfl(l - ^ I+;+1 )’ 1 ( 5 ) 

n€.V(r,c) i—0 j—0 

that recovers |3j with a — 1 Il20l 21J. Gansner later considers the l-traces of 
plane partitions, 

tr^(zr) = n i,j' ^ € Z, (6) 

H=t 

and extends (|5j into the trace generating function 

e n t/ ,( ” ) =nnfi-ri«) c> 

neV(r,c) -r<(<c i=0 j=0 \ t=-i ) 

that recovers 1 5) with q, — q for every t G Z except for qo — aq H6]|7|. (Gansner 
provides in 1161171 more general results on (reverse) plane partitions of arbitrary 
shape.) 

Both the generating functions (|5]) and |7| generalize the norm generating 
function § for plane partitions with unbounded size of parts. We now have a 
simple question: Are there analogues of (|5j and 0 which generalize the norm gener¬ 
ating fiinction (| 2}/or plane partitions with bounded size of parts'? A naive answer is 
no because the simple replacement of V(r, c ) in (|5]) and |7} with V(r, c, n) does 
not results in nice (product) formulae. As is clarified in this paper (Theorems [9] 
and[T7|, however, the answer may be yes when we seek those from sums of the 
forms 

E q^a tr ^(v„(7t) and ^ co n (n) qj 1 ^ (8) 

n€.V(r,c,n) n€.V(r,c,n) —r<i<c 
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that include some weight functions co n for plane partitions such that a> n (n) —> 
1 as n —>■ oo. 

Orthogonal polynomials appear in various areas of mathematics, see, e.g., 
122 S. In combinatorics many combinatorial interpretations are given to vari¬ 
ous families of (classical) orthogonal polynomials |5|. A combinatorial theory 
for general orthogonal polynomials is also given by Viennot who develops a 
unified combinatorial approach to orthogonal polynomials by means of path 
diagrams l23][24] . Analogous results are also obtained for biorthogonal poly¬ 
nomials El (which are different from, in precise, a special case of biorthogonal 
polynomials examined in this paper) and for Laurent biorthogonal polynomi¬ 
als mm- In this paper a combinatorial interpretation to general biorthogonal 
polynomials is developed in terms of (weighted) lattice paths on a square lattice 
(Section [3). 

Non-intersecting paths and determinants are fundamental tools for analyz¬ 
ing plane partitions |01lj3'll j. In this paper the combinatorial interpretation of 
biorthogonal polynomials is applied to deriving nice formulae for plane par¬ 
titions with bounded size of parts where exact evaluations of determinants 
are performed by means of biorthogonal polynomials. Specifically the little 
q-Laguerre polynomials and their generalizations are examined to derive nice 
formulae generalizing the trace-type generating functions |5| and (JtJ. 

This paper is organized as follows. In Section[2]basics of biorthogonal poly¬ 
nomials needed in this paper are described. In Section [3] a combinatorial inter¬ 
pretation of (general) biorthogonal polynomials is developed in terms of lattice 
paths on a square lattice. 

In Section[4]the combinatorial interpretation is applied to the little q-Laguerre 
polynomials as a concrete example. The results are utilized in Section[5]to derive 
a nice formula for plane partitions with bounded size of parts which general¬ 
izes the norm-trace generating function (j5j for those with unbounded size of 
parts (Theorem [9j. The discussion in Section |4] is generalized in Section [6] for 
the generalized little q-Laguerre polynomials newly introduced there, and the re¬ 
sults are used in Section[7]to derive a nice formula which generalizes the trace 
generating function (JtJ (Theorem [T7). 

The orthogonality of the generalized little q-Laguerre polynomials (Theo¬ 
rem [12) is proven by means of a generalization of the q-Chu-Vandermonde 
identity I10JEL5] for basic hypergeometric series (Lemma [TT). The proof of the 
lemma is given in Appendix [A] 


2 Biorthogonal polynomials 

Let K be a field. Let J- : IK x +l , y +1 J — »■ IK be a linear functional defined on 
the space of Laurent polynomials in x and y over IK. Due to the linearity, T is 
uniquely determined by the moments 

fi,i = hi) e Z 2 . (9) 
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Let us define determinants of moments 


A h' C) = , det ( fr+i,c+j ) 
0 <i,]<n 

fr,c 


fr+i,i 


fr 


r,c+j 


fr+i, 


■c+j 


fr,c+n—\ 


fr+i, 


,c+n —1 


( 10 ) 


Jr+n—l,c ’ ’ ’ fr+n—l,c+j ' ' ' Jr+n—l,c+n —1 
for (r,c) £ Z 2 and n £ Z>o where Ag^ — 1. We assume throughout the paper 

(r cj 

that the determinant A„ ' does not vanish. 

We define a (monic) biorthogonal polynomial P„' c \x) £ K[x], (r,c) £ Z 2 , 
n £ Z>o, (with respect to J-) as a polynomial such that the leading term of 

(r c) 

P„ ' (x) is x n and the orthogonality 


J r [x r y c+ jpj l r ' c \x)] = h^Sj >n , 0 < j < n, (11) 


(r c) 

holds with some normalization constant h„' £ K \ {0} where Sj n denotes 

(r c) 

the Kronecker delta. The biorthogonal polynomial P„ ' (x) is uniquely deter- 
mined from T. Indeed P n ’ ' (x) should have the determinant expression 


fr,c 

fr,c+j 

fr,c+n—l 

1 


fr+i,c 

fr+i,c+j 

fr+i,c+n—l 

X 1 

x(Ap>)-' (12) 

fr+n,c 

fr+n,c+j 

fr+n,c+n —1 

x n 



from the monicity and the orthogonality CD- (Write down © in a linear 
system for the coefficients of P„ c (x) and apply Cramer's rule.) We have from 
© and (12) that 


h 


(r,c) 

n 


A 

A 


(r,c) 

n+1 

( r +) ’ 
n 


(13) 


The reason why we call P, 


(r,c) 


(x) "biorthogonal polynomials" is the follow- 


4 







ing. Let us consider a monic polynomial in y 


Qn (y) = 


/r,c 

Jr,c+j 

Jr,c+n 

• + • ■ 

n 

fr+i,c+j 

fr+i,c+n 

fr+n—l,c 

fr+n—\,c+j 

fr+n—l,c+n 

1 

yl 

y n 


x (A, 1 ,'- 1 ')-'. (14) 


We then have the biorthogonnlity between P„ c (x) and Qn' c (x) that 
J r [x r y C Pm' C) (*)Qn' C) (y)] = hn ' C ^fi m ,nr Ttt, H £ Z> 0 . 


(15) 


(r c) \ . 

We thus call P „ ' ; (x) biorthogonal polynomials in view of the existsnece of 

(r c) 

biorthogonal partners Q„ ' (y). 

Remark. The biorthogonal polynomials considered here naturally involve (or¬ 
dinary) orthogonal polynomials. Orthogonal polynomials, say P„(x), n £ Z>o, 
are polynomials with deg P n (x) — n satisfying the self-orthogonality 

J 7 [P m (x)P„(x)] = h n S m ,n, m,n£ Z> 0 , (16) 

with some linear functional J- : K[x] —> K and some constants h n f 0, see, 
e.g., mam. If we regard x and y as the same indeterminate x — y biorthogonal 
polynomials then reduce to orthogonal polynomials. 

The following proposition plays a key role in our combinatorial interpreta¬ 
tion of biorthogonal polynomials in Section [3] 

Proposition 1 (cf. fll9l ). The biorthogonal polynomials satisfy the adjacent relations 


xPl r+l ' c \x)=P^l{x)+a^pl r ' c \x), 
pi r ' c) (x) = p f l r ' c+1) (x) + fejjT' c) p£^ +1) ' 


for (r, c) £ Z 2 and n £ Z>o with P^ c+1 ^(x) = 0 where 

fr+l,c) ^(r,c) 


„M _ ^ _ \ + , 


h 


b ( r ' c ) - 
u n 


( r , C ) 

n 

fr,c) 


A 


( r +\,c) ^{r,c)’ 


n +1 


, (r,c+l) 

H —1 


A M A (r,c+l) 

a n+l fl )i-l 

A h,c) A ( r ' c+1 ) ’ 


x) 


(17a) 

(17b) 


(18a) 

(18b) 


Proof. We expand xP/, r+1 ' c ^ (x) into a linear combination of pjj' c \x). Since 
xP,i 1,c (x) is a monic polynomial in x of degree n + 1 we have 


W +w w = p^ l w + E»W' ) (*) 

k =0 


(19) 
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with some constants Ay which can be determined as follows. Multiply x r if to 
the both sides of (19) and apply F. We then obtain Aq — 0 from the orthogo¬ 
nality © and hence 

X p(r+U) = pM (*) + <* k pM (x) . (20) 

k= 1 


Next multiply x r y c+1 and apply F similarly We then obtain ci\ — 0 from © 
and 


xpZ+ 1 *\x)=p';F*)+t*4"\*)' 


k=2 


( 21 ) 


and so on. We finally find that do — ■■■ — — 0 and 

W +U) (x) = P%l(x) +«„F,b>M. 


( 22 ) 


Here multiply x r+n y c 


and apply F to find that u n — h„ +1 ' L ' ) /hn' C ‘ — a\ r / c ' 1 


from 


©. We thus obtain ( |17a[ ). The relation (JTTbJcan be obtained in almost the 
same way as 1 17a} by using the orthogonality llTJ. □ 


3 Lattice path combinatorics 

We show in Section [ 3 ] a combinatorial interpretation of (general) biorthogonal 
polynomials in terms of lattice paths on a square lattice. The combinatorial 
interpretation partly owes the basic idea to the combinatorial theory of general 
orthogonal polynomials developed by Viennot 123 . 241 . 

Let us view a two-dimensional integral lattice Z> 0 (in the first quadrant) as 
a square lattice. We depict the square lattice in matrix-like coordinates where 
the south and east neighbors of the point ( i,j ) £ Z> 0 are (i + 1 ,j) and ( i,j + 1) 
respectively. The square lattice Z 2 >0 makes a graph of vertical and horizontal 
edges connecting every two neighboring lattice points. Let a h j £ IK for (i — 
1 ,j) £ Z 2 0 . We then label the vertical edge connecting ( i,j ) and (i — \,f) by 
txi'j and every horizontal edge by 1, as shown in Figure [l] 

Lattice paths considered in this paper are those on the square lattice Z?, 0 
which travel from some lattice point to another with north and south (unit) 
steps. For example, a lattice path going from ( 4 , 0 ) to ( 0 , 6 ) is shown in Fig¬ 
ure [l] Conventionally the two endpoints of a lattice path may coincide with 
each other so that the lattice path is an empty path of no steps. The weight 
of a lattice path P, w(P ), is defined to be the product of the labels of all the 
edges passed by P. For example, the lattice path in Figure [l] has the weight 
w(P) = a 4 / 2 « 3 , 4 « 2 , 4 a l, 5 - The weight of any empty lattice path is assume to be 1. 

The following theorem provides a foundation of our combinatorial inter¬ 
pretation of biorthogonal polynomials. 
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Figure 1: The square lattice Z> 0 with edges labelled. The thick line shows a 
lattice path on the square lattice going from (4,0) to (0,6). 


Theorem 2. Assume that 

cci.j = ifi > j; (23a) 

- bf' H) ifi < j (23b) 

for each (i — 1,/) € Z> 0 where the right-hand sides are coefficients of the adjacent 
relations ( fT7| among biorthogonal polynomials. Let {r, c ) € Z> 0 . The moments |9} of 
biorthogonal polynomials then satisfy 

j £ = L w ( p ) ( 24 ) 

J0,c p 


where the sum ranges over all the lattice paths P on the square lattice Z> 0 going from 
(r, 0) to (0 ,c). 


Proof Let us assume 
induced from 


for labels on vertical edges. The formula 1241 is then 


OO 

x r P^\x) = E Pl°' C \x) E w(P W ) (25) 

k =0 p(k) 

where PW in the second sum is over all the lattice paths going from (r + n,n) 
to (k, c + k). (The first sum with respect to k — 0,1,2,... is actually a finite sum 
because, if k > r + n or k < n — c, there are no lattice paths PW going from 
(r + n, n) to ( k,c + k) and hence £p(q w(P W) = 0.) Indeed, when n — 0, we 
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( 26 ) 


multiply y c to the both sides of l |25| and apply F to obtain 

f, c = F'F«F) 

p( o) 

from the orthogonality (JTTJ) where P' 0 ' goes from (r, 0) to (0,c). The last equa¬ 
tion is equivalent toj24} since — fg /C from ©• 

We now prove <|25)l. We first show that 

CO 

vpp 0) w = £?<"■”>«£>( r«) (27) 

;=0 P W 


where P^* runs over all the lattice paths going from (r + n,n) to (j,j) on the 
main diagonal. The formula (|27j) can be proven by induction with respect to 
r — 0,1,2,... as follows. If r — 0 the formula \27\ reads 

P, { ,°' 0) (x) = P, ( , 0 ' 0) (x)a;(p|" ) ) (28) 

where pE is the unique (empty) lattice path going from and to (n, n). The 

equality p8) is surely true since w(P+) — 1. Assume that r > 1. From the 
adjacent relation ( |17a] > we then have 

x r Pn’°\x) = x r " 1 P ) ( I '^ 1 1,0) (x) + a r + n/n x r_1 p// 1,0 ^(x) (29) 


where a r +„ /f , = a,, 1 '* 1 ' from (23aJ. The assumption of induction yields that 

/ 


p^°\x) = E p r j (*) e 


,( 0 , 0 ) 


/O')) 


y'O'h 


(30) 


;=o 


V p - 


h;') 


□"O') 


where P'l !> and P'!^ run over all the lattice paths going from (r + n,n + 1) to 
(j,j) and those from (r + n — 1 ,n) to (j,j) respectively. The lattice paths going 
from (r + n, n) to (j,j) are classified into two classes: those starting with an east 
step, labelled by 1, followed by a lattice path going from (r + n, n + 1) to (/,/); 
those starting with a north step, labelled by ot r +n,n, followed by a lattice path 
going from (r + n — 1 , n) to (/,/), see Figured We can thereby unify the two 

sums for P'^ and P”^ in < [30) into that for P+ going from (r + n,n) to (],])'■ 

E w(P+ ;) ) + 0t r+n ,n E ™{ p + i] ) = E W { P +)- (31) 

p'(j) p"(j) pH) 

We thus obtain | [27) . We can show in a similar way that 

OO 

ff 0) M= (32) 

t=0 pO» 
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(r + n,n) 


1 


(r + n,n + 1) 


M-r-\-n,n 
(r + n,n) 


Figure 2: Classification of lattice paths going from (r + n, n) to (j, j) into those 
starting by an east step labelled by 1 (left) and those starting by a north step 
labelled by oc r + n , n (right). 



to (/',/') while Pp' k> from (;',/') to ( k,c + k). 

by using [17b} and [23b} where P_ * runs over all the lattice paths going from 
(j,j) to ( k , c + k). Substituting ( [32) for [27} we get 

M r '°\x) = £ Pf c) (x) £ £ (33) 

k =0 j=0 ( P (j) jpU*)) 

where (pP,Pp' k p ranges over all the pairs of a lattice path pP going from 
(r + n,n) to and a lattice path Pp' k) going from (/',;') to ( k,c + k). Note 

that we can concatenate pP and Pp ,li! at (j,j) to get a lattice path, say pU' k \ 
going from (r + n,n) to ( k,c + k) via ( j,j ) on the main diagonal. Therefore, 

since w(P^)w(Pp’ lc ^) — w(P^ ,k ^) r 

OO CO 

£ X] = EE ™(p w ) = E®(p (fc) ) c 34 ) 

j=0 (p(j) j=0p(j,k) p(k) 

where PW in the last sum runs over all the lattice paths going from (r + n,n) to 
(k,c + k). We thus obtain [25} from [33} and [34} . That completes the proof. □ 
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Figure 4: An 77-tuple (Pq, ..., P„_i) G CV(r,c,n) of non-intersecting lattice 
paths on the square lattice Z> 0 where ( r,c,n) — (4,5,3). 


Theorem[2]provides a combinatorial interpretation of moments of biorthog- 
onal polynomials in terms of lattice paths on a square lattice. The combinatorial 
interpretation of moments leads to the following combinatorial interpretation 
of determinants of moments. For (r, c,n) G Z> 0 we define CV(r, c, n) to be the 
set of n-tuples (Pq, ..., P n -i) of lattice paths on the square lattice Z> 0 such that 

(i) P/ c goes from (r + k, 0) to (0, c + k); 


(ii) P 0 ,..., P n _ i are non-intersecting, namely Pj DP k =(Z) if j J- k. 
Figure[l]shows an example of such an 77-tuple ( Pq, ..., P„_i) G CV(r, c,n). 
Corollary 3. Let ( r,c,n) G Z> 0 . Then 


A 


(r,c) n-1 

1 -rn—1 f — = E n^)' 

1 bc=0 JO,c+k (P 0 ,...,P n _i)eCV(r,c,n) k=0 


Proof. Theorem |2] implies that 


—^- = det I V>(P,;) 

n^ 0 /0,c+fc 0<i,/<n^ 


(35) 


(36) 


where P,_ ( runs over all the lattice paths going from (r + i, 0) to (0, c + j). We can 
directly equate the last determinant with the sum in the right-hand side of ( [35) 
by means of Gessel-Viennot-Lindstrom's method |[8] [17], see also f2} Chapter 
31]. □ 


4 Little tj-Laguerre polynomials 

We examine in Section 4] the little q-Lagnerre polynomials as a concrete exam¬ 
ple of the combinatorial interpretation of (general) biorthogonal polynomials 
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discussed in Section [3] The results are applied in Section [5] to deriving a nice 
formula for plane partitions with bounded size of parts which generalizes the 
norm-trace generating function (j5j by Stanley 120. 21 ]. 

In what follows we adopt the following conventional notations for ^-analysis: 
^-Pochhammer symbols 


fr l ~ar 

1 -®r 


with abbreviation 


I~I(1 ~aq k ) 

k =0 

if n > 0, 

(37a) 

1 

if n = 0, 

(37b) 

na-^r 1 

k—n 

m 

if n < 0, 

(37c) 

m’/q)n — J q)n/ 


(38) 


;=i 


and basic h vpe rgeo m etr i c series 

2‘h(“' b ;<i.x) =E 


a,b \ ^ {a,b;q), . 

■ - " -rJ 


j —o \ c ' c l' c l)j 


x>. 


(39) 


The (monic) little q-Laguerre polynomial of degree n £ Z>o is given by 


L n (x; a;q) 


n(n— 1 ) 

(-1 ) n q^~{aq- r q) n 


x 2<pi 


q~ n , 0 

aq 



(40) 


The little (/-Laguerre polynomial is a classical orthogonal polynomials which 
resides in the Askey scheme, see 1T51 §14.20] and the references therein. In this 
paper we think of the parameters a and q as independent indeterminates so 
that L n (x;a;q ) E K[x] with K = C (a,q). (The reader can instead think of a and 
q as complex constants such that 0 < |^| < 1 and 0 < \aq\ < 1 as in Ifl5l .] 

Let us fix the linear functional J- : IK [i' +l , i/ +1 ] —» K by the moments 

fi,j = ?[x l yi] = ( aq) +1 ;q)i , ( i,j) € Z 2 . (41) 

For (r, c) £ Z 2 and n G Z>o let us write 


Ln' C ^ (x; a;q) = L n (x;aq r+C ;q). (42) 

The orthogonality (Tl) and the adjacent relations (17) for the little £/-Lagucrrc 
polynomials are given as follows. 

(r c) 

Proposition 4. The little q-Laguerre polynomial L n ' ’(x',a;q) satisfies the orthogo¬ 
nality < [TT| ) ivith pjf' c \x) — L„ ,c \x; a; q) and 

/4 r ' e) -/,- /C+ „x a" q< r+c+n \q-,q) n (43) 


with respect to the linear functional T having the moments (411 where f r , c +n = 
F[x r y c+n \. 
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Proof. From l|4(j|-l|42| we have 

g£jO] 

(-1 ) n q ,} ^ {aq r+c+1 ; q) r 


- (aq c+ i +1 -q) V (t? 11 ,aq’ +L+i+1 ; q)j ,■ 

~ {aq ' q)r k ^q r+c+ U)i q 


fr,c-\-j 2^1 


i =0 

^-” / ^ r+c+ / +1 




r+c+1 ' 


/ tf/ 


We here apply the ^-Chu-Vandermonde identity 

a n {a^ 1 c-,q) r 


2<Pl 


q n , a 


',q,q I — 


( c-,q)r. 


( 44 ) 


(45) 


[15. Eq. (1.11.5)], lllOl Theorem 12.2.4] to the last hypergeometric series to get 

a n qn( r +c+j+V(q-j;q) n 


2</>l 


q- n ,aq r+c+ i +1 


aq 


r+c+l I 


(•aq r+c+1 ;q) n 

a„q n ( r+ C + n +1 \q- n -,q) ri 

{aq r+c+1 }q)„ 




(46) 


for 0 < j < n. Substituting (J46]) for 1441 we obtain the orthogonality with 

' H 


Remark. The (self-)orthogonality of the little q-Laguerre polynomials is usu¬ 
ally described by 

f^L m (qi-a-q)L n (qi-a-,q) ^\ = a - }?'^ n S m ,n, m,n £ Z> 0 , (47) 

(<?;<?); {aq n+1 ;q) oo 

03 §14.20]. The orthogonality ]47) can be equivalently written as 


r ;rr / . . w , M _ a n q n2 {q-q)n . 

(aq n+i ;q)oo 


(48) 


with the linear functional J- 7 : K[x] —> K determined by the moments J- 1 [x ! ] — 
(i nq;q)i . It is easy to see that (|48j is equivalent to the orthogonality stated in 
Proposition |4] 

Corollary 5. The little q-Laguerre polynomials L„ 1 (y;a;q) satisfy the adjacent re¬ 
lations ( fl7l ) zvith Qn(y) = L„ \y;a;q) and 

4^) =q n (l-aq r+c+n+1 ), (49a) 

=aq r+c+n (l-q n ). (49b) 

Proof. That is immediate from Propositions [l]and [4] □ 
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The lattice path combinatorics for biorthogonal polynomials, discussed in 
Section p] is applied to the little q-Laguerre polynomials as follows. In view of 
Theorem|2]and Corollary[5]we label the vertical edge between ( i,j ) and (i — 1 ,j) 
in the square lattice Z> 0 by 

oij j — q ! ( 1 — aq 1 ) if i > j; (50a) 

= aqi (1 — q l ) if i < j, (50b) 

and every horizontal edge by 1. In the rest of Section [4] and in Section [5] we the 
weights of lattice paths are evaluated with respect to this specific labelling. 

Let (r, c) E Z 2 >0 . Let P be a lattice path on the square lattice Z> 0 going from 
(r, 0) to (0, c). Viewing the finite region bordered by P as a Young diagram we 
can naturally identify P with an (integer) partition of at most r parts whose 
parts are at most c. We write A(P) for the partition. For example, the lattice 
path P in Figure[l]is identified with the partition A(P) = (5,4,4,2). 

Let A be a partition. The norm | A | is equal to the number of boxes contained 
in the Young diagram of A. The Dnrfee square is a maximal square that can be 
contained in a Young diagram. We define D(A) to be the size of the Durfee 
square of the Young diagram of A. Obviously D(A) is equal to the number of 
boxes on the main diagonal of A. We note that D(A(P)) — d if and only if the 
lattice path P passes through (d, d ) on the main diagonal. 

Lemma 6. Let ( r,c) E Z> 0 and let Pbea lattice path on the square lattice Z> 0 going 
from (r, 0) to (0, c). The weight w(P) with respect to the labelling given by (50) then 
admits that 


w(P) 

( aq ; q)r 

oo(P;a-,q ) 


q \m\ a DMP)) w (p. ta;q) 

(?W)d(a (p)) 

( flt ?W)D(A (P)) 


where 


(51a) 

(51b) 


Proof. We "factor" the labelling given by (50} into two distinct labellings; one 
puts on the vertical edge between ( i,j ) and (i — l,j) 



— aq 


i 


and the other 


cc'i'i — 1 — aq 1 

= 1 -q' 


if i > j ; (52a) 

if i < j, (52b) 

if i > j; (53a) 

if i < j. (53b) 


We write w'(P) and w" (P) for the weights of a lattice path P with respect to the 
labellings given by (52) and (53) respectively. Obviously w(P) — w'(P)w"(P). 
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Let P be a lattice path mentioned in the lemma. It is easily seen from (52) and 
(53) that 

w '(P)=qW) l fl D W p )) (54) 


and 


w 


\p) = ri(W) n = 




17— d-\-l 


( ( P ( ?)r 


(55) 


respectively where d — D(A(P)). We therefore have ©■ □ 

Theorem|2]and Lemma|6]imply the following. 

Theorem 7. Let .F be the linear functional (for the little q-Laguerre polynomials) 
determined by the moments (41) . Let (r, c) £ Z> 0 . Then 

= E? |A(p)lflD(A(p)) "(-P;«;‘?) (56) 

[ClCjfCjjr p 


where the sum ranges over all the lattice paths P on the square lattice Z> 0 going from 
(r,0) to (0,c), and co{P‘,a;q) is given by (51b) . 

Proof. Delete w(P) from (24) and © to get the result where/o, c = (aq c+1 ;q )0 = 
1 from (4l) . □ 

The left-hand side of (56) is equal to 

fr,c _ ( aq c+1 ;q) r _ ( aq;q) r+c 


{aq;q) r ( aq’,q) r {^qi q)r{^q) q)c 

that generalizes the ^-binomial coefficient 

(q;q)r+c 


(57) 


r + c 
r 


jq (qiq)r(qiq)c 

The formula (56) thereby gives a generalization of the well-known formula 


(58) 


r + c 
r 


E? 


A(P)| 


(59) 


for a combinatorial interpretation of the ^-binomial coefficients JT) §1.6]. 
Corollary |3]and Lemma|6]imply the following. 

Theorem 8. Let T be the linear functional (for the little q-Laguerre polynomials) 
determined by the moments (41). Let ( r,c,n ) £ Z> 0 . Then 


A 


(r,c) 


n —1 


nLo ( a T' q)r+k (P 0 ,...,P n _ 1 )eCV(r,c,n) 
where co(P '*■; n; q) is given by (51b) . 


^=0 W p *)lfl^=o D(A(P t )) pi cv(P k ;a;q) 
k =0 

(60) 
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Figure 5: The 3D Young diagram corresponding to the plane partition (J63J. 


Proof. Combine ( [35) and © to get the result where fo /C — ( aq c+1 ; q)o = 1 from 

, □ 

We note that the right-hand side of ||60) is equal to the determinant 


a!') _ ( ( ac T'tf)r+c+i+j \ 

n^o (aq;q)r+k 0<i,j<n y(aq;q) r+i (aq;q) c+ j J 

that generalizes the ^-binomial determinant 


det 

0 <i,j<n 


> + C + i + f\ \ 

- T + i V 


(61) 


(62) 


5 Nice formula for plane partitions with bounded 
size of parts, I 


Itis customary to depict a plane partition n — (TTyy) 2 , 7 = 1 , 2 , 3 , in a three-dimensional 
(3D) Young diagram in which 7T h j (unit) cubes are stacked over the position (i, j). 
For example, the plane partition 


/3 3 3 2 2\ 

3 3 3 1 1 

3 3 2 1 0 

\3 2 0 0 0/ 


(63) 


is depicted as the 3D Young diagram shown in Figure [5] The norm \ n\ is then 
equal to the number of cubes stacked in the 3D Young diagram of n. 

As is mentioned in Section[l]Stanley finds the norm-trace generating function 
for plane partitions with unbounded size of parts 


r— 1 c —1 

£ q\ n \a tr W = n rK 1 “ aq i+ i +1 )- 1 (64) 

nEV(r,c) i =0 j =0 


where V(r,c) denote the set of plane partitions of at most r rows and at most 
c columns, and tr(zr) the trace of n EnjEU. Based on the results on the little 
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Ai(/r) = 


A 2 (tt) = 


A3O) = 


Figure 6: The cross-sections Aj-(7t) at level k — 1,2,3 of the 3D Young diagram 
7T in Figure [5] 


zpLaguerre polynomials in Section [4] we find in Section [5] a nice formula for 
plane partitions with bounded size of parts which is analogous to ( [64) and gen¬ 
eralizes the norm generating function |[ 2 f for those with bounded size of parts 
by MacMahon IfTBlI . 

Let (r,c,n) G Z 3 >0 . The V{r,c,n) denotes the set of plane partitions of at 
most r rows and at most c columns whose parts are at most n. For example, the 
plane partition |63) belongs to V ( r , c, n ) if and only if r > 4, c > 5 and n > 3. In 
other words n G P(r, c,n) if and only if the 3D Young diagram of 7 T is confined 
inanrxcxn rectangular box. 

In view of 3D Young diagrams it is so natural to characterize plane parti¬ 
tions by means of (integer) partitions as follows. Let n be a plane partition. For 
each leZ>i we define a partition (n) by the cross-section at level k of the 
3D Young diagram of n. For example, the plane partition ( ]63) , or the 3D Young 
diagram in Figure [5] gives rise to the partitions 

Ai(tt) = (5,5,4,2), A 2 (7t) = (5,3,3,2), A 3 (tt) = (3,3, 2,1) (65) 

and Ajt( 7 t) — Q) — (0,0,0,...) for k > 4, see Figure[ 6 ] Another characterization 
of Afc( 7 r) given as: the z-th part of Aj-( 7 t) is equal to the number of parts in the 
z-th row of 7 i which are at least k. The map n 1 — > (Ai( 7 t), A 2 ( 7 r), ^(n), ...) is 
clearly a bijection between plane partitions and sequences (Ai, A 2 , A 3 ,...) of 
partitions such that Ai D A 2 D A 3 D ■ ■ ■ D A^ = 0 for some M G Z > 3 where 
A D p means that A totally contains or coincides with p as a Young diagram. 
Obviously 


kl = E \ X k{n)\, 

k=1 

h(7r) = E D ( A fc( 7T )) 

k=l 


( 66 ) 

(67) 
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where n\\ denotes the (1, l)-part of a plane partition n, and D(A) the size of 
the Durfee square of a partition A. 

We now recall a well-known bijection between V ( r , c, n) and CV ( r , c,n), see 
Section[3]for the definition of CV (r, c,n ). Let A G V (r,c,n). For each integer k, 
0 < k < n, draw on the square lattice Z 2 >0 a lattice path P k going from (r + k, 0) 
to (0, c + k) such that 

H p k) = (^^_i5' A n-u( 7r )'---'A„-fc,r(7r)) + {k r+k ) (68) 

k times 

where A n -k,ii n ) denotes the z-th part of the partition A n _ k (n), and (k m ) — 
(k,...,k) of m parts equal to k. Graphically speaking, the lattice path F) r is 
obtained in the following procedure: 

(i) Draw on Z> 0 a lattice path Pj, going from (r, 0) to (0, c) such that A (P' k ) = 
An-ki^r)- 

(ii) Translate P k by (k, k) (so that Pj, goes from (r + k,k) to ( k,c + k)). Let us 
write P" for the obtained lattice path. 

(iii) Add k consecutive east and north steps to the initial and terminal points of 
P" respectively (so that P" goes from (r + k, 0) to (0, c + k)). The obtained 
lattice path is P/ c . 

For example, the procedure works as shown in Figure [7] for the plane parti¬ 
tion ( [63) or for the 3D Young diagram in Figure [5] The relation that A| (tt) D 
■ ■ ■ D A n ( tt) guarantees that the obtained lattice paths Po,.. ■ ,P n -i are non¬ 
intersecting and hence (Po,..., P n -i ) G CV ( r,c,n ). This procedure thus gives 
a map from V(r,c,n) to CV(r,c,n). 

The above map from V(r,c,n) to CV(r,c,n) is invertible. In fact, for any 
(Po,.. .,P„_i) £ CV(r,c,n), the non-intersecting condition forces P/ ; to start 
and end by k consecutive east and north steps respectively. So the inverse of 
(iii) in the procedure, of removing the k consecutive east and north steps, can 
be safely performed for any (P 0 ,... ,P„_i) G CV{r,c,n). There are no diffi¬ 
culties on the inverses of (ii) and (i), and the non-intersecting condition for 
(Po,..., Pn _i) guarantees that we surely obtain a 3D Young diagram after ap¬ 

plying the inverses of (iii), (ii) and (i). The procedure therefore gives a bijection 
between V(r, c,n) and CV(r,c,n). 

Suppose that aplane partition n G V(r, c,n) and an n-tuple (Pq, ..., P„_i) G 
CV (r, c,n) of non-intersecting lattice paths correspond to each other by the bi¬ 
jection. It is immediate from [68) that 

|A(P, C )| = \A n _ k (n) \ + k(r + c + k), (69a) 

D(A(Pfc)) = D(A„_fc(A)) +k. (69b) 
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Figure 7: The bijection between V{r,c,n) and CV{r,c,n) with ( r,c,n ) = 
(4,5,3). 


Therefore 

r |A(P t )| = |,| + "("-l)(3'- + 3c + 2»-l) | 
k =0 6 

E|D(A(P i c))|=tr(7r) + ^-^. 

k =0 Z 


(69c) 

(69d) 


The bijection between V(r,c,n) and CP{r,c,n), with ( [69) , allows us to trans¬ 
late Theorem[8]in the language of plane partitions. 

Theorem 9. Let ( r,c,n ) G Z> Q . Tfoen 


E 

7tGV(r / c,n i 




r—1 c-1 n—1 i _ i+j+k+2 

■i^M)=nnn _ U. 

i=0 ;=0 k= 0 1 “9 

^ (^“ fc+ 1 W) D (Ad 2 r)) 
w n {n;a;q) = jj 


revere (70a) 
(70b) 


El (a<? n - fc+ 1 ;^ D (Ad 2 r)) 
zc/zere ztpi denotes the (1,1 )-part of a plane partition n. 

Proof. The bijection between V{r,c,n) and CV(r,c,n), with the help of 
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allows us to equivalently rewrite the formula (60 1 in Theorem[8]as follows: 


A 


he) 


E q | 7 V r( 7 r W/r ;a;q) = n(B _ 1)(3r ^ +2w _ 1) 

nev(r,c,n) q 5 a 2 

(71) 


Note that D(A^(7 t)) = 0 for k > zryi. The proof thus amounts to the evaluation 

of the determinant A^' c ^ of moments (41~) of the little ^-Laguerre polynomials. 
From 1131 we have 


A 


(r,c) 

n 


re —1 

it'- 


he) 

k 


k=0 


(72) 


for general biorthogonal polynomials. We therefore find from the normaliza¬ 
tion constant ( (43) for the little c/-Laguerre polynomials that 

(r r \ n(n—l)(3r+3c+2n— 1 ) n(n—l) —_1 , , 

A h' =q s a ““ 2 — JJ(fl£? c+,:+1 ;(j) r (^;^) fc . (73) 

k=0 

Substituting the last equation for (TT) we obtain 


E 

n£V(r,c r n) 


q\ n \ a u ^ n ' > to n (TV, a-, q) = 


*r =0 


(fl^ c+l:+1 ;tjf) r 

( aq k+1 -,q) r 


(74) 


The last product is equal to the right-hand side of (70a) . □ 

The nice formula (70) for plane partitions with bounded size of parts gen¬ 
eralizes the norm-trace generating function (64) for those with unbounded size 
of parts. Indeed ,V{r,c,n) —> V(r,c), co n (n;a;q) —> land 


r—1 c— 1 ft—1 

nnn 


i=0 ;=0 fc=0 


1 - aq i+ i +k+2 
1 - aq i+ i +k+1 


r— 1 c—1 

nn 


i=0 ;=0 


1 - aq n+i+ i +1 
1 - aq i+ i +1 


^nria -^ 1 )- 1 

;=0 ;=0 


(75) 


as « —>■ oo since lim„_>.oo q" — 0 as a formal power series in q (or as a complex 
number with \q\ < 1). The nice formula (70) also recovers the norm generating 
function (2) for plane partitions with bounded size of parts with a — 1 since 
LO n (TV,V,q) = 1 from (70b) . 


6 Generalized little ij-Laguerre polynomials 

We show in Section [6] another concrete example of the combinatorial interpre¬ 
tation of biorthogonal polynomials discussed in Section[3] We introduce a gen¬ 
eralization of the little q-Laguerre polynomials and examine the lattice path 
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combinatorics of those. The results in Section [6] are utilized in Section [7] to 
derive a nice formula for plane partitions with bounded size of parts which 
generalizes the trace generating function |7) for those with unbounded size of 
parts. 

In what follows we use the following notation: For any bilateral sequence 
x — (..., x_ 2 , x_i,xo, X\, X 2 , ■ - -) and n £ Z, 

00 V , n 

x n — FT —— = FT x k if 11 > 0; (76a) 

fc=o x ~ k it=l 

= 1 if n = 0; (76b) 

0 

= ]~J xf 1 if n < 0. (76c) 

k=n +1 

Let a be an indeterminate and let 


P = (• • •, P- 2 , P-i, Po, Pi, Pi ,---), (77a) 

<! = {■•■, R-2, <7-1/ <70/ Ri, Ri,---) (77b) 

be bilateral sequences of indeterminates pi and qj. We write 

Pm = (• • • / Pm—2/ Pm—1/ Pm/ Pm+ 1/ Pm+2/ • • ■ )/ (78a) 

^ m — (• • • / tfm—2/ tfm—1/ tfmr Rm+1, Rm+2, ■ ■ ■ ) (78b) 


for the m-shifted sequences where po = p and q$ = q. We define the generalized 
little q-Lagnerre polynomial of degree n £ Z>g by 


C n {x; a;p,q ) 




n —1 / 

e n ( ac i 

t>v,*>*">i/ w _i>0 k—i \ 



(79) 


where the second sum in the right-hand side is over all the n — 7 non-increasing 
nonnegative integers i'„ ..., i' H -i at most i. 

The generalized little (/-Laguerre polynomials, as the name suggests, gen¬ 
eralize the little c/-Laguerre polynomials as follows. 

Proposition 10. If Pe — qe — qfor every (, then C n (x;a;p,q) — L n {x-,aq~^-,q). 
Proof. Suppose that Pe — qe — q for every t. We then have 


C n (x;a;p,q) = ( —1)"^ ' 2 ’ {a;q) 


n 

x t ( ~ X)W 




i=0 ( a 'R)i 

The second sum in the right-hand side reads 


£ q~ L k=i v k. (80) 

i>Vj>”*>l/ n _i>0 


E n—1 .. 
k=i V k — 


E <7 ^ k=i 

i>Vi>”’>v n -i>0 


= £ < 7 ~ w - ( "' q)i (81) 


where we used (|2j. We get the result from 1 40 1 , 1 80 1 and 




□ 
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Before stating the orthogonality of the generalized little ^-Laguerre polyno¬ 
mials we show a summation formula which will be used to prove the orthogo¬ 
nality 

Lemma 11. Let n £ Z>o. Let a, c, p, p n -1 an d <7 1 , • • •, q n -i be indeterminates. 
Then 


E 


i =0 




E 

i>Vi>->V n -l>0 


n —1 


n c< 7 





fc =0 


(82) 


The proof of Lemma [IT] is given in Appendix |A| 

The summation formula ( [82) generalizes the ^-Chu-Vandermonde identity 
[45) fl5l Eq. (1.11.5)], IfTOl Theorem 12.2.4]. In fact, the [82) recovers [45) with 
the specialized parameters pe — cj( — q for every £. (The method used to prove 
Proposition[lO]is also applicable to see that.) 

We now state the orthogonality of the generalized little tj-Laguerre polyno¬ 
mials. Let us fix the linear functional T : K[x ± 1 ,i/ ±1 ] —» IK, K = C(fl, p, q), by 
the moments 


hi = wi = n pSr 

k =1 1 -ap q’ 


Yl(l-ap k q’) 
k =0 

if i > 0 ; 

(83a) 

1 

if / = 0 ; 

(83b) 

n(l-apV)- 1 

k=i 

if i < 0 

(83c) 


for ( i,j ) £ Z 2 . For (r,c) £ Z 2 and n £ Z>o let 


’(r,c) 


{x-,a;p,q) — C n (x;ap r q c ; p r , q c )- 


(84) 


Theorem 12. The generalized little q-Laguerre polynomial Cn' c \y; a; p, q) satisfies 
the orthogonality [Tl) with pjf ,c \x) — Cn' c \x;a;p,q) and 

hn' C) = fr,c+n x fl" p r+k {q c+k - q c+n ) (85) 


k =0 


ivith respect to the linear functional T having the moments (831 where f r ,c+n — 
J-\x r y cJrn \. 

that 


Proof. We have from [79) , [83) and 
J r [x r y c+ i (x; a;p,q)] 


fr,c + jYllZlp k 

n (i —1 


= Em|i-«rV + ' 


1=0 U =0 VPr 


e 

z’>i/j>-”>t/ M _i>0 k—i \ 


E[ I a v r q c qc Vk - -p =J • (86) 
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Lemma [lT]with parameters 


a <— ap'q c+ f 


c <— ap'q c , 


Vl ^ Vr+t’ C U t-- q c+ £, 


such that p <— p, and q q c , allows us to replace the right-hand side of 
with 


(87) 

<( 86 ) 


fiW ■ £ - apW +i ) = «" n P f (cj c+k ~ q c+ i). (88) 

k =0 k =0 

We thus have the orthogonality stated in the theorem since the last product 
vanishes for 0 < j < n □ 

The adjacent relations for the generalized little q- Laguerre polynomials are 
given as follows. 

(y c) 

Corollary 13. The generalized little q-Laguerre polynomials C n ' ' (y; a;p,q) satisfy 
the adjacent relations with Pn' c \x ) = Cn' c \x-,a;p,q ) and 

a n' C ^ — Pr{ 1 — ap'q c+n ), (89a) 

b ( f’ c) - ap r+n ~ 1 q^(l - q*). (89b) 

Proof. Proposition [l] and Theorem [12| directly yield the result. D 

Let us apply the lattice path combinatorics for biorthogonal polynomials in 
Section |3] to the generalized little y-Laguerre polynomials. Corollary [13] sug¬ 
gests the following labelling for edges of the square lattice The vertical 
edge between ( i,j ) and (i — \,j) is labelled by 

ot,,j = p]_ h i(l ~ ap l -i- x qi) if i > j- (90a) 

= ap^qi-f l - q l hi ) if i < j (90b) 

while every horizontal edge by 1. We consider in the rest of this section and in 
Section[7]the weights of lattice paths with respect to this labelling. 

Let A be a partition. For each f £ Z we define D/ (A) to be the number of 
boxes on the f?-th diagonal of the Young diagram of A where a box at ( i,j) is 
said to be on the f?-th diagonal if and only if j — i — L Especially Dq(A) = D(A) 
that measures the size of the Durfee square of the Young diagram of A. For 
example, the Young diagram A = A(P) of the lattice path P in Figure[l]satisfies 
that (D f (A ))_ 4 <^<6 - ( 1 , 2 , 2 ,3,3, 2 , 1 , 1 , 0 ). 

Let (r, c) € Z > 0 and let P be a lattice path on the square lattice Z>g going 
from (r,0) to (0, c). If i > 0(resp. iff 7 < 0), D^(A(P)) = d if and only if P passes 
through (d,d + £) (resp. through (d — £,d)). We write A, (P) for the z’-th part of 
the partition A (P). 
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Lemma 14. Let ( r,c ) G Z> 0 and /ef P be a lattice path on the square lattice Zf 0 
going from (r, 0) to (0, c). T/ze weight w(P) zvith respect to the labelling given by < |90) 
then admits that 


zv(P) — a 


= „Do(A(P)) /jj p D_,(A(P)) j [ n^^ (A(P)) 


w=i 


co' r (P;a;p,q) where 

(91a) 


07 


n 

i—i 


' r (P;a;p,q) = { flC 1 “ ^.(pj-j) J | El I 1 -"! 7 ' Ai(?) V i(P) )J (91b) 


zzz/zere d — D(A(P)). 

Proof. The proof is totally parallel to that of Lemma[ 6 ]in Section|4] We "factor" 
the labelling | |90) into two distinct labellings; one puts on the vertical edge 
between ( i,j ) and — the label 


- ap^qF 1 


and the other 


= (1 ~ «P' ’ V) 


- (1 - «?}_,) 


if z > ;; (92a) 

if i < j, (92b) 

if i > j ; (93a) 

if i < (93b) 


where both the labellings put 1 on every horizontal edge. For any lattice path 
P we write zv'(P) and w"(P) for the weights of P with respect to the labellings 
( [92) and (|93) respectively Obviously w(P) — w'(P)w"(P). 

Let P be a lattie path going from (r,0) to (0,c) and let d — D(A(P)) = 
Dq(A(P)). We then have from (921 that 


w 


'(p) - 


0=1 


n 

\i—d -\-1 


A,(P) 

Pi-A,(p)-i 


(94) 


since P passes through the vertical edge between (z’,A;(P)) and (z — 1,A,(P)) 
for each integer i, 1 < z < r. The last expression is actually equivalent to 


W ’(p)= « d o(a(p)) (n Pl D -' (A(p)) ) fnO WP)) 
0=1 


c—1 


9=i 


(95) 


To see this we consider to fill in the Young diagram A(P) by writing in to the 
A;(P) boxes in the z-th row 


Pi, ■ ■ ■, Pi-i, a, ql, ■ ■ ■, q\i{p)-i if 1 < z < d; (96a) 

Pi—A;(P)—l' Pi -2 if d < z < r (96b) 
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<?2 

<73 

<?4 

n 

a 

<n 

<72 


pi 

pi 

a 

<7l 


P3 

P2 





Figure 8: The filling of the Young diagram of the lattice path in Figure [T] 


from left to right. For example, the lattice path in Figure [T gives rise to the 
filling shown in Figure | 8 j The way of filling ensures that the product of all 
the entries in the Young diagram is equal to zv'(P). In addition the entries 
a, pi and qj reside in the boxes on the main, (—z) -th and j- th diagonals re¬ 
spectively. We therefore have (95], It is easy to find from (93] that w"(P) 


is equal to co' r (P; a; p, q) defined by ((9Tb). We thus have (91a] since w(P ) = 
w'(P)w''(P). □ 


Theorem|2]and Lemma [l4]imply the following. 

Theorem 15. Let T be the linear functional (for the generalized little q-Laguerre 
polynomials) determined by the moments ((83]). Let (r, c ) £ Z> 0 . Then 


f r , c = Y.a D 0(A(P) ) 

p 



D-i(A (P)) 



d dm) 


(v' r {P;a;p,q) (97) 


where the sum ranges over all the lattice paths on the square lattice Z > 0 going from 
(r,0) to (0, c), and co' r (P;a; p,q) is defined by (91b] , 

Proof. Delete w(P) from (24] and © where /o /C = 1 from (83] . □ 

Corollary |3]and Lemma [14| imply the following. 

Theorem 16. Let T be the linear functional (for the generalized little q-Laguerre 
polynomials) determined by the moments (83], Let (r,c,n ) £ Z> Q . Then 


A 


y,c) 


' '{W 1 , , (n-k){n-k- 1) 

11 (Pr+ktfc+k) 

T =0 


- -1 


n a - 9^-0 

l<i<k<n 

^ «eudo (mi) (fi q ^° iim)) ' 


(Po . Pn-i)sCV(r,c,n) 


.i=l 


W =1 


x w' rn (Po,...,P n -r,a-,p,q) (98a) 
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where 


( Pq, ■ • •, P n - 1 ;«; P/ q) 


71 — 1 


r+fc 


= n no-4™-.) n . <»» 

fc=0 (l=fc+l J l.lWi+1 J 

zp/zere d*. = D(A(Pj.)). 

Proof. For a lattice path P let iv'(P) and w" (P) be the weights of P defined 
in the proof of Lemma [l4| T hen zv’(P) satisfies (|95j, and w"(P) is equal to 
co' r (P;a;p,q) defined byi|9Tbi. Since zv(P) — zv'(P)zv"(P ) Corollary [3] and 
Lemma [l4]induce that 


a M _ 


e n w'(p k ) w "(p k ) 

(P 0 .P„-i)e£P(r,c,n) k =0 


(99) 


where fo /C+k = 1 for every k from l 

Let (P 0 ,...,P„_i) G CV(r,c,n). The condition for the lattice paths Pq, ... ,P n -\ 
to be non-intersecting forces P/ c to start (from (r + k, 0)) with k consecutive east 
steps and ends (to (0, c + k)) with k consecutive north steps. Hence 


D -r-i(Pk) — P>c+i(Pk ) —k — i 
A/(P/c ) = C + k 

We have from | |100a) that 


for 0 < i < k < n; (100a) 

for 1 < i < k < n. (100b) 


Yl w '( p k) = II fl 


1 D 0 (A(p t )) In 1 „ D -iM p k)) 


n pr ( 


k =0 


k =0 


1 = 1 


^c +k— 1 

n % 

\ i =1 


D j(A(P k )) 


= DoWft)) pfkJ D_i(A(P,))^ I'j-j ^ 


c 1 U'Co D /(A(P*)) N 


where 


x ^ n (Pr+itfc+i) 
l 0 <i<k<n 


k-i 


11 —I 


(n-k)(n-k- 1) 


I^T (.Vr+itfc+i) — WiVr+ktfc+k) 
0 <i<k<n k=0 


We have from (100b I that 


n»"w ; n{n(i- 4 H) 

fc=o *=o L 1=1 


r+/r 


(101a) 


(101b) 


n (i-«p‘- A ^)-y^); 

k z=d£-|-l 


= v'r, n (Po,---,Pn-i;a- r p,q)x J1 (l-q l c+k _i) (102) 

l<i<k<n 


Substituting (JTOTJ) and 11021 for ( |99) we obtain (|98j in the theorem. 


□ 
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Theorem[l2) Corollary[l3| Lemma[l4]and Theorems [l5|and[l6]in this section 
respectively recover Proposition |4j Corollary[5] Lemma|6fand Theorems [7] and 
|8]in Section|4]with the specialized parameters a nq and p, — qj — q. This re¬ 
auction is consistent with that of the generalized little z/-Laguerre polynomials 
to the little zpLaguerre polynomials mentioned in Proposition [To] 


7 Nice formula for plane partitions with bounded 
size of parts, II 

We derive in Section[7]another nice formula for plane partitions with bounded 
size of parts based on the generalized little p-Laguerre polynomials introduced 
and examined in Section [6] The nice formula would generalize the trace gener¬ 
ating function for plane partitions with unbounded size of parts 

l n tf' < ” ) =nn(i-ri*') <i®> 

7teV(r,c) -r<£<c i=0 j=0 \ l=—i ) 


developed by Gansner @[71 where tiy.(7r) denotes the l-trace of a plane parti¬ 
tion 7i = (7T ij) defined by tq>(7r) = n i,j- 

The discussion in this section is totally parallel to that in Section[5 Employ 
the bijection between P(r,c,n) and CP ( r, c, n ) to translate Theorem 16] in the 
language of plane partitions. (The bijection is discussed in Section|5]) 

Let us remind several symbols defined in the preceding sections. For a 
lattice path P on the square lattice Z 2 , (| A(P) denotes the (integer) partition 
whose Young diagram is given by the finite region bordered by P; for a plane 
partition n, /\/,( n) the partition whose Young diagram is given by the cross- 
section at level k of the 3D Young diagram of n, see Figure |6j Let us write 
A-k,i ( tt) for the z'-th part of the partition Aj-(7i). 

Suppose that aplane partition tt 6 V( r, c,n) and an zz-tuple (Pq, ..., P n ~ i) G 
jCP (r, c,n) of non-intersecting lattice paths correspond to each other by the bi¬ 
jection. It readily follows from ||68) that 


d £(A (P k )) — D^(A„_^(7t)) +k 

for 0 < k < n and —r< l < c that implies 


n 1 77 (1-1 — It 

ED,(A(P Jt ))^tr £ (7r) + ^—-± 

k =0 Z 


It also follows from 1681 that 


^ n—k,i—k (^0 T ^ 


(104a) 


(104b) 


(104c) 


for 0 < k < n and k < i < r + k. 
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Theorem 17. Let (r, c, n) G Z> 0 . Then 


E « 

n^P{r,c,n 


< r „w 


(v r ,n(n;a; p,q) 

— 1 C —1 ft — 1 

nnn 


^ ri’ri 1 - ap‘qi +k+1 


i =0 7=0 fc=0 


1 — ap'q) +k 


(105a) 


where 


oo, 


n \1 f D k __ 

■Awp.q )=n i fit 1 - 


fc=l (!=1 


X \ n (!- ap i - x *.iW- 1 q n ~ k+x An)) l ) JJ(1 - ap^qn-b) 


(105b) 


^i—Dk+l 


i =1 


zc/iere n\ : \ denotes the (1,1 )-pnrt of a plane partition n, and D * = D(Aj-(7i)). 

Proof. Suppose that 7r G V(r,c,n) and (Pq, ..., P„_i) G CV{r,c,n) correspond 
to each other by the bijection. We then have from 1 104b) that 


ae^doca (p*)) ^n P F jD - i(A(Pi) )) (rj 


E^o 1 D ; (A(P k )) 


' r—1 


* c —1 


n(n—1) 

—2— 


= < a 


n pi Tin 


x a 


o=i 


W=i 


,r " i ”> (rbh ( ” , J (rj?, ,r,( ’ r) 


(106) 


We also have from 1104c I that 


{ r-ln-1 1 

nna — ap'q k ) > x co r , n (Tz;a;p,q) (107) 

i =0 k=0 J 


Note that Aj-(/r) =0 and Aj-, (7r) = 0 for A; > zrij. The formula 1981 in Theorem 


16 is hence equivalent to 


E « 

n€.V(r,c,n 


tro(nr) ( fj pj r -i(^) 


h-1 

JJ* 


try(Tt) 


O 0 r,n(o 0 ) a, p, 


a(g c ) f r—1 w—1 _ 

nn( i_fl pV) 

l i=0 (t=0 


Av) 


(108a) 
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where 


(r,c) I 
K„ — < a 


fr -1 N 

n?.- 

V! = l ) 


' c -1 N 

EK 

/ 


n(n—1) 
2 


The proof thus amounts to the evaluation of the determinant A„' of moments 


' 4-4 , . (n-k)(n-k-l) 

IK Vr+k^c+k) 2 

.k =0 


n (1 -nUk-i) 

k l <i<k<n > 


(108b) 


[83) of the generalized little c/-Laguerre polynomials (examined in Section [ 6 ). 
We have from |13) that 


A 


, > n -1 , , 

r,c - n 4 r,c 

k =0 


(109) 


for general biorthogonal polynomials. Substituting the normalization constant 
( [85) of the generalized little c/Laguerre polynomials for the right-hand side we 
straightforwardly find that 


ah , =*h , nn(i-«pV +i ‘)- 

i =0 fc =0 


( 110 ) 


□ 


Substituting [IIP) for 1 108a) we obtain the formula 1 105a) . 

The nice formula 1 105) for plane partitions with bounded size of parts gen¬ 
eralizes the trace generating function | |103) for those with unbounded size of 
parts. Indeed, V(r,c,n) —> V(r,c), cu r/n (n;a;p,q) —>■ 1 and 


r-lc-ln—l i —ntt i ai +k+1 

nnn , f h 

i= o j =o k= o 1 - ap'q ]+K 


r-lc-l i _nn i n n +j r-1 c-1 _ _ 

nn - pq jj ^nna-W)- 1 aid 

t=o 7=0 1 -ap l qi i=o y=o 


as n —t oo since lim^oo q" — 0 , where the convergences of cv r/n (n;a;p,q) 
and in [ 111 ) are as formal power series in q\, c/ 2 , c/ 3 ,... (or as complex numbers 
with \qi < e < 1 for every £ with some real e G (0,1)). We thus obtain as a 
consequence of (1051 that 


neP(r,c) 


f r -1 , \ fc —1 „ , A r-lc-l 

J-j- p tr_ ; (7r) \ / -r-r _tr,-(7r) 


.i=l 


n*r' Knna-wr 1 m 

W=1 / i=o ;=o 

that is nothing but the trace generating function 1 103) with a <— qo and q_i — p,- 
for i > 1 . 

The nice formula | |105) also generalizes the nice formula |70) derived from 
the little c/-Laguerre polynomials where the former respects all the /-traces 
while the latter only the (O-)trace and the norm that is equal to the sum of the 
/^-traces. It is easy to see that we can derive [70) from 1 105) by the specialization 
that a •(— aq and p, = c/ ( — q for every i and j. This reduction is consistent with 
that from the generalized little q- Laguerre polynomials to the little c/-Laguerre 
polynomials (Proposition [To) . 
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A Proof of Lemma ITT! 


We give a proof of Lemma[TT]in Section[ 6 ] The proof depends on the following 
two facts. 

Fact 18. Let kq, U\, a. 2 , ■ ■ ■ be a sequence of constants. Let us consider a (Newton) 
polynomial in x 


n i —1 

f{x) = J^CiY[{x- 0 C k ) 
i =0 k=0 


(113) 


ivith constant coefficients Cj. We determine constants c> ,t £ Z>q, 0 < i < n, by the 
recurrence 


cf +1) = c}° + («f+i+l - «t)c2i 


ivith cj 0 ^ = c; and cj^ = 0. Then 


fix) = Ec ; w n(*-« f +it) 


(114) 


(115) 


i—0 k=0 

and therefore f {at) — Cq for each t E Z>o- 

The simple induction for t E Z>o readily proves Lemma [18] The statement 
of Lemma 18 is nothing but interpolation by Newton polynomials where the 
recurrence iTll reads the well-known divided-difference 


c® = 


„(f+i) _ (t) 


(116) 


see, e.g., 0 §7.1]. 

Fact 19. Let uq, u\, U 2 , ■ ■ ■ and v\, V 2 , V 3 ,... be sequences of constants. Let 

m 

F{m,n, r)= £ TK u ik+r ~ v j k +k) ( 117 ) 

0<;'i <— <j m <nk= 1 

for m, n, r E Z>o where F(0, n, r) = 1. The recurrence 

F{m,n, r + 1) = F{m,n, r) + (u n+ 1 - u 0 )F{m - 1 ,n + l,r) (118) 
ffen holds for m E Z>i n, r G Z>o- 

Proof. We prove 1 118] by induction with respect to m = 1,2,3,.... We have 
from ( |11 7) that 


/(1,«,T) = Y]( u i+T — v i+\) 
i =0 


(119) 
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that implies < |118) with m 
of generality, that t = 0 . 
induction that 


= 1. Assume that m > 2 and, without any loss 
We then have from (117) and the assumption of 


n 

F(m,n, 1) = E (u jm+1 - Vj m+rn )F(m - 
jm= 0 
n 

= E ( u im +1 - v j m +tn)F{m - l,;'m,0) 

jm=0 

n 


The sum in 


+ E ( U /m+l V jm+m)( U j m +l 

jm —0 

1120 a | is equal to 


uo)F(m 


2 , j r}; + 1,0). 


(120a) 

(120b) 


n 

F(m,n, 0) + E (M/in+l - u im) F ( m - l 'jm, 0) 

im=0 

m—1 

— F(m,n,0) + E (M B+ 1 -My m _i) n ( M /i ~ ( 121a ) 

0<;i<"'<; m -i<Ji+l fc=l 


while the sum in 


( 120 b) 


n+1 


E ( u jm - v im+m-i){uj m - uo)F(m - 2,; m ,0) 

;'m=l 


m —1 


E ~«o)n (“;*- p fc+*)- ( 121b ) 

o</i<-<; m -i<w+i fc=i 

Gathering | |121a| ) and 1 121b} we obtain the right-hand side of ( |118) . That com¬ 
pletes the proof. □ 


We now prove Lemma [TT] 

Proof of LeminnfTT\ The summation formula ( ]82) is equivalently written as fol¬ 
lows: 


E 


i=0 




E n hr “ cqn ~ k ~ k 

0</i <•■■</„ i<ik=\ \P ,k / 


Jt=0 

( 122 ) 


We think of the both sides of \\22) as polynomials in a, and write /(fl) and g{a) 
for the left-hand and right-hand sides respectively. We prove f(a) = g(a) as 
polynomials by showing that /(fl) — g(a) for infinitely many a's. It is obvious 
that 

£(l/> f ) = fl ("7 -cf) ( 123 ) 

k =0 \P J 
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for any t£ Z. We evaluate fit / //) by use of Facts 
Let rtf — 1 /p f and let 


18 


and 


19 


c, = 


e nfT-«r*-‘ N 


0 <h<-<j n l <ik=-l \P 

~ri—1 


( 124 ) 


so that f(a) = Ef=o c z - n* = o(« — At)- The recurrence ( |114| ) with cj 0 ^ — c,- and 
cj^i = 0 is then solved by 


c« = 


e n 

0 </i<-</ n _i<ik=l VP 


1 


t+jk 


- cq ll -i*- k 


(125) 


Indeed the recurrence | |114) with rtf = 1 / p* and 1 125) gives the identity ( |118) > in 
Fact[l9]with parameters 


Uj i -=, V; cq n f m i — n — i, n i. 

1 »‘+; ; ' 


(126) 


Fact [18] thereby implies that 


/(i/p0=/(**)= 4 °=fi (= n (-7 - c< 7 fc ) ~ ^(1/p f ) 

it=i Vp / /c=o Vp / 


for t £ Z>q. That completes the proof of Lemma [IT] 


(127) 

□ 
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